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Abstract 

We discuss progress on the problem of asymptotically describing 
the complex homogeneous adjacency eigenvalues of random and com¬ 
plete uniform hypergraphs. There is a natural conjecture arising from 
analogy to random matrix theory that connects these spectra to that 
of the all-ones hypermatrix. Several of the ingredients along a possible 
path to this conjecture are established, and may be of independent 
interest in spectral hypergraph/hypermatrix theory. In particular, we 
provide a bound on the spectral radius of the symmetric Bernoulli 
hyperensemble. 


1 Introduction 

Spectral hypergraph theory attempts to link the spectral structure of ma¬ 
trices and hypermatrice^ associated with hypergraphs (i.e., set systems, 
usually in which every set has the same cardinality - termed “uniform”) to 
the combinatorial properties of those hypergraphs in a manner analogous to 
spectral graph theory. It is far from straightforward to define appropriate 
hypermatrices and spectra of such objects, however, and the strengths and 
weaknesses of each theory are a subtle matter. The main approaches to date 
can be roughly classified as follows: 

1. Matrices and linear spectral theory. One natural tactic is to 
define various types of matrices associated with the hypergraph and 
relate their “ordinary” eigenvalues back to the hypergraph. Prominent 

^ There is a convention in the literature to refer to hypermatrices as “tensors”, although 
the identification is not entirely consistent with other fields’ use of these terms. We choose 
to use “hypermatrix” to refer to a multidimensional array in order to avoid any confusion 
on the matter. 
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successes in this vein include Feng-Li [8] and Martinez-Stark-Terras 
m, who used vertex-edge incidence matrices; Lu-Peng |24l I25j . who 
defined a kind of higher-order adjacency matrix between sets of vertices 
instead of single vertices; and Rodriguez [3ll[35l|36], who also defined 
a type of adjacency matrix by counting edges containing vertex pairs. 

2. Hypermatrices and low-rank decompositions. Another approach 
is to define a hypermatrix, i.e., a higher (than two) dimensional array 
of numbers whose entries (for example) indicate whether the indices 
of that entry are a hyperedge; a natural choice of indicator is to use 
0 and 1 as in the case of graphs. The dimensionality of the array is 
known as the hypermatrix’s “order”; it is called “cubical” if the set 
of indices in each such dimension has equal cardinality; and it is said 
to have “dimension n” if this cardinality is n. Then, one asks for a 
decomposition into rank one hypermatrices (outer products of vectors 
with themselves), just as in the classical Spectral Theorem from linear 
algebra. While low-rank decomposition of tensors (for present pur¬ 
poses, multilinear maps that are associated with hypermatrices under 
particular choices of basis) are a highly studied subtopic of applied 
multilinear algebra - “Tucker” and “canonical polyadic” decomposi¬ 
tions are umbrella terms for a number of such techniques - it is not 
easy to see how to use them for adjacency hypermatrices. Nonethe¬ 
less, Friedman and Wigderson m did essentially that with consider¬ 
able success, later spawning deeper results such as those of Keevash- 
Lenz-Mubayi [T9l [JHl [HI [22], who have been able to connect quasir¬ 
andomness, expansion properties, and “second largest eigenvalues” in 
a way that closely resembles Cheeger inequalities and the Expander 
Mixing Lemma of classical spectral graph theory. Another, highly 
algebraic approach worth noting here is that described by Gnang, El- 
gammal, and Retakh (e.g., in m)- Their strategy uses a variant of 
Bhattacharya-Mesner tensor algebra to define a different kind of spec¬ 
tral decomposition for hypermatrices. 

3. Hypermatrices and polynomial maps. One can define hyper¬ 
matrices associated with a hypergraph as above, but consider their 
entries as coefficients of multilinear forms and study the algebraic and 
analytic properties of the maps given by these polynomials and the 
homogeneous polynomials of which they are polarizations (when the 
hypermatrices are fully symmetric, i.e., permutation of index sets fixes 
the entries). This approach to studying symmetric tensors dates back 
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at least to Lyusternik-Snirel’man |26j . but was resurrected by Lim [TJj 
in an analytic form and Qi [30] in an equivalent but more algebraic 
fashion; in the latter case, the author gave a very useful (and intuitively 
appealing) description of the spectrum as the roots of a characteristic 
polynomial, the resultant of the polynomial system whose coefficients 
are drawn from the original hypermatrix with A subtracted from its 
diagonal entries. The subject one obtains by applying this definition of 
spectra of hypermatrices to adjacency (and related, such as Laplacian) 
hypermatrices has become a very rapidly growing field: see, for exam¬ 
ple, [iiiiiiaiaiaiiiigiisTiiiaEiiiTiiisiiiHiisiiiMiiaiiaiMiiiiiiiaiig 
In work most relevant to the present manuscript, the complex homo¬ 
geneous eigenpairs of the adjacency hypermatrix A[H) are the object 
of study, i.e., solutions (A, v) to the equation 

A{H) : = Av°(^-i), 

where denotes tensor contraction, “(8)” tensor product, and “o” 
denotes the product of hypermatrices known variously as “Hadamard”, 
“Schur”, and “entrywise”. (See the next section for more on our choice 
of notation.) For a fe-uniform hypergraph H, the left-hand side denotes 
“multiplication on all but one side” of the order k hypermatrix A{H) 
by a vector, and the right-hand side denotes a scalar multiple of the 
same vector with all entries raised to the {k — l)-st power. 

One of the most applicable topics in spectral graph theory is the the¬ 
ory of the spectrum of random graphs; this area serves as a crucial tool 
for understanding quasirandomness, graph expansion, and mixing time of 
Markov chains, for example. A natural desideratum, therefore, is a descrip¬ 
tion of the spectra of random (Erdds-R&yi) hypergraphs, i.e., hypergraphs 
in which edges are chosen according to iid Bernoulli distributions. One very 
special case of this problem, when the probability of including an edge is 
1, is the question of describing the spectrum of the complete graph. In the 
case of graphs, a complete description of the eigenvalues (and eigenvectors) 
of complete hypergraphs is an easy exercise, but the same task is surpris¬ 
ingly difficult for hypergraphs. For hypergraphs of uniformity 3, [6| gives a 
kind of implicit description that is not very illuminating and does not seem 
to generalize well. For higher uniformities, the adjacency hypermatrix is 
very close to the (scaled) all-ones hypermatrix, the eigenpairs of which were 
completely described in [7], differing only in the vanishing fraction of en¬ 
tries corresponding to repeated indices (i.e., degenerate edges). Therefore, 
a theorem to the effect that, if two hypermatrices are “close” in some sense. 
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their spectra are “close” as well would suffice to understand the spectrum 
of complete hypergraphs. We venture the following vague conjecture: 

Conjecture 1. Suppose A and B are hypermatrices so that ||A — i?|| < e 
for some norm || • || (or spectral radius) and e > 0. There there is a bijection 
p between the eigenvalues (with multiplicity) of A and B and a function f 
with lime_).o/(e) = 0 so that |A — /5(A)| < /(e) for each eigenvalue A. 

Indeed, inequalities of this flavor ~ the Weyl, Hoffman-Wielandt, and 
Lidskii inequalities most prominently - are an important topic in matrix 
theory. The standard proofs of such statements, however, rely on the Spec¬ 
tral Theorem via the Courant-Fischer Theorem, two key tools which are as 
of yet (mostly) missing for hypermatrices. However, there are “variational” 
proofs that do not rely on the Spectral Theorem (see, for example, mmy, 
the idea is to show that the eigenvalues vary (piecewise) smoothly along a 
curve in matrix space connecting A and B and that the derivative of the 
eigenvalues are bounded by some norm of H — H, so that one can integrate 
along the path to obtain a perturbational result. Analogizing such proofs 
for hypermatrices is far from straightforward but should be possible. For 
example, [23] provides a smoothness result for spectral radii. In the present 
paper, we apply results from analytic function theory (see [33l|29|) to show 
that all eigenvalues do indeed vary piecewise smoothly along line segments 
connecting A and B in hypermatrix space. The step of showing that the 
derivative is bounded by a norm-like function of A—B is the next main prob¬ 
lem to address in this program, and is made difficult both by the fact that 
matrix-theoretic proofs of analogous results use smoothness of the eigenvec¬ 
tors (something that is difficult to generalize to hypermatrices because the 
singular surfaces involved are no longer linear spaces but some much more 
complicated varieties) and ordinary norms are not in general holomorphic 
(because they involve the modulus function). However, there is reason to 
believe that the relatively simple differential behavior of algebraic sets along 
curves will permit the effective use of homotopy techniques (tools such as 
HU [391 ESI). 

One reason to push for a generalization of perturbational inequalities 
such as the conjecture above is that it would also lead to a full (asymptotic 
almost sure) description of the eigenvalues of random hypergraphs. Indeed, 
the adjacency hypermatrix of a random hypergraph is, with high probability, 
very close in any reasonable norm to another appropriately scaled copy of 
the all-ones hypermatrix, so that the above program would also yield the 
distribution of their spectra. Since the eigenvalues of random graphs (and 
the closely related topic of random 0/1 and random ±1 matrix ensembles 
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of various types) is another central and important area in matrix theory, 
this is a natural problem to consider. Below, we show that random ±1 
symmetric hypermatrices have small spectral radius (maximum modulus of 
an eigenvalue) with high probability in a certain precise sense, so again the 
missing piece of this argument is a Weyl-type inequality. 

In the next section, we introduce notation and definitions used through¬ 
out, as well as outline an argument approaching Conjecture [H In Section 
[3l we show that the difference between a suitably scaled all-ones hyperma¬ 
trix and the adjacency hypermatrix of a complete hypergraph has a small 
spectral radius. In Section HI we do the same for random hypergraphs. 
Then, in Section [5l we show that the eigenvalues along a line segment of 
hypermatrices vary piecewise smoothly. 

2 Definitions 

For a hypergraph H = iV(H), E{H)) of uniformity k (i.e., E{H) C (^^^^))) 
we define its adjacency hypermatrix as the hypermatrix Ah = [aii,...,ifc] whose 
(ii,..., ifc)-th entry is given by 

1 f 1 ii{ii,...,ik}^E{H) 

_ ij! I 0 otherwise. 

Here, i = {ii,... ,ik) is referred to as a multiindex. A hypermatrix is sym¬ 
metric if its entries are invariant under permutation of the entries of its 
multiindices. The shape of a hypermatrix is the vector of lengths of its in¬ 
dex sets; the dimension of this vector is the order of the hypermatrix. If 
all entries of the shape are equal a hypermatrix is cubical, and its common 
index set size is the dimension] note that the adjacency hypermatrix of a 
hypergraph is cubical of dimension equal to the number of vertices. Given 
two hypermatrices A and B of the same shape, write AoB for the Hadamard 
product, i.e., the hypermatrix of this same shape whose entries are given by 

{A o B)i = AiBi 

where i is a multiindex. Write (8) for tensor product, i.e., given A and 
B hypermatrices of shapes a = (ai,...,as) and b = {bi,... ,bt), for i = 
(ci,..., Cs+t) with Cj G [uj] for j G [s] and cj G [bjs] for j e[s-\-t]\ [s], 

{A < 8 > B)i = Aci^...^cB^CB+i,...,CB+f 

In general, given an (associative) binary operator * and an object X to which 
it is applied, we define X*^ = X and, inductively, X*^ = X * for 
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integers fe > 1. Write for the cubical order k hypermatrix of dimension 
n all of whose entries are 1 , i.e., = 1 ®^, where 1 is the all-ones vector 

of dimension n; if A; = 1 we omit the superscript; write for the cubical 
order k identity hypermatrix of dimension n, i.e., all of whose diagonal 
entries (all entries of the multiindex equal) are 1 and 0 otherwise. Given 
two hypermatrices A and B with A order k and a set of indices S C [/c] with 
|5| = s and B of order s, write A :s B for tensor contraction: 

n 

{A :s 

(1\ .. ,Q.s = 1 

where i(oi,..., 5), with S = {ji,... ,js}, denotes the multiindex whose 

t-th coordinate is if t ^ S' and t is the r-th largest element of [n] \ S or is jr 
if t G S and t is the r-th largest element of S. If S = [k] or A is symmetric, 
then we omit the subscript on and simply write A : B (if the shape of 
A and B are the same, this reduces to the Frobenius product of A and B; 
thus, the choice of notation). Finally, in a slight abuse of notation, we write 
A-^ for : A°^ = : A. 

An eigenpair of a hypermatrix A is a pair (v. A) G M"' x R with v 7 ^ 0 so 
that 

A : 

By m, in close analogy to linear algebra, it is also possible to define the 
eigenvalues (the A above) as the roots of the equation 

det(AI^ - A) = 0 

where det{B) is the hyperdeterminant of hypermatrix B, defined as the 
resultant of the polynomial coordinates of B : where x is a vector of 

variables. (The definition of hyperdeterminant/resultant is difficult to give 
explicitly; we refer to | 12 ] for the interested reader.) 

In the interest of approaching Conjecture 1, we make the following ar¬ 
gument. Suppose that A = A{t) is a smooth hypermatrix-valued function, 
t G [0,1], with the property that it is possible to assign indices to the 
n{k — !)"■ eigenpairs of A(t) so that {vj{t), \j(t)) is a smooth function of t. 
Then we may write 

^ = Av°''-^ ( 1 ) 

Assume for the moment that 

= 1 ( 2 ) 

as well. This assumption loses no generality, because eigenvectors can be 
freely scaled, as long as v'^ 7 ^ 0 ; otherwise, a different argument must be 
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made. Differentiating ([2]) (and writing the derivative of f{t) with respect to 
t as /'), we obtain 

vofc-i . + ^ok -2 o v' : V + o v' : v°2 + • • • = 0. (3) 


Note, however, that all addends on the left-hand side are equal, so they are 
all zero. Operate on both sides of ([T]) on the right by v” to obtain 

A : v®'' = = A. (4) 


Then, differentiating Q, we obtain 

= A' : v®^ A : (v' (g) v®*'“^) +A: (v ® v' ® v®^“^) H- 

= A' : v®^ + kA : (v®^-^ 0 v') 

= A' : v®^ + kA : v®^-^ : v' 

= A' : v®^ + kAv°^-^ : v' 

= A' : v®^ 

by symmetry of A and ([3]). Continuing, we have 

y = A': v®^ < sup f A' : v®^) =: lU'lL , 

vGS V / ^ 


where S C is some set containing all eigenvectors Vj(t} for all t G [0,1]. 
Therefore, 

|A,(0)-A,(1)|< ['\\A'{t)\\^dt 

Jo 

In particular, if A{t) = Aq + Bt and define Ai = ^(1), we obtain 




(5) 


Even if the Xj and vj are only piecewise smooth, this argument still provides 
the same upper bound by telescoping the sum of the piecewise integrals 
obtained by breaking the f-path at singular points. If a reasonable set S 
can be chosen - in particular, so that ||i?||s is small - the result is a Weyl- 
type inequality and thus a description of the spectrum of the complete and 
random hypergraphs. In Section [5l we show that the eigenvalues of A{t) 
indeed vary piecewise smoothly in t, so the problem remains to show that 
eigenvectors do as well. 
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3 Complete Hypergraphs 

Let B{n,k) denote the difference between the appropriately scaled all-ones 
hypermatrix and the adjacency matrix of the complete /c-uniform hyper¬ 
graph, i.e., 

For a hypermatrix A, define the spectral radius of A by 


P{A) 


max |A|. 

AGSpec(A) 


We apply the following lemma from |46j . 

Lemma 1 . Suppose A is a nonnegative order k, dimension n hypermatrix 
with entries Then 


min V aji 2 -ik < P{^) < “ax V aji^-h 

3 ^^ 3 ^^ 

*2,...,4gN 

It is simple to obtain a bound on the spectral radius of B(n, k) from this 
lemma. 


Theorem 2. For n > k, we have 


p{B{n,k)) < 


{n — 1 )^ ^ 


Proof. The number of A:-tuples ii,... ,ik with ii = j and no indices repeated 
(i.e., is 7 ^ ij for s 7 ^ t) is (n — 1)^^. Therefore, the number of fc-tuples 
ii,... ,ik with ii = j and some index repeated is 


(„ - 17-1 - - l)tl = ^ (*= L („ _ l)*-! 

i=i ^ 2 


k-l 




2=1 

00 


<(n- 
< (n — 1 ) 


il \n — 1 
k-lY 


n — 1 


2=1 

k-l {k-l)/{n-l) 


1 — {k — l)/{n — 1) 
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Therefore, by Lemma [U 


^ / -I \ t—1 k 1 

< (n- 1)'' -- 

n — k 

< (A: - l)(n - 1)^-2. 




(n — 1)^ ^ 
{k-2)\ 


□ 


4 Random Hypergraphs 

Let D{n,k,p) denote the difference between the appropriately scaled all-ones 
hypermatrix and the adjacency matrix of the random /c-uniform hypergraph 
with probability p G (0,1), i.e., 

D{n, k,p) = -{k- iy.A{Gk{n,p)). 

The special case of p = 1/2 is of particular interest, since then 2D{n, k, 1/2) 
is the random symmetric sign hyperensemble, i.e., an order k, dimension n 
hypermatrix whose entries hi, where i = {ii,... ,ik) is a multi-index, are iid 
±1 with probability 1/2 if zi < • • • < ij. and determined by symmetry for all 
other entries. Let U{n, k,p) denote a random “upper symplectic” {p,p— 1}- 
hypermatrix, i.e., an order k, dimension n hypermatrix whose entries t-, 
where i = {ii,... ,ik) is a multi-index, are independently p with probability 
1 — p or p — 1 with probability p if zi < • • • < ik, and 0 otherwise. 

For a vector v G , denote by ||v||fc the usual A:- norm, i.e., 

I'"" 

Proposition 3. Let V G be such that ||v ||2 = 1. Then 

for some absolute constants c, C > 0, where U = U(t,k,p)- 

Proof. Let Ui denote the order A; — 1 hypermatrix obtained by fixing the 
first coordinate to i, i.e., 

Ui — U .02, 


Pr 


\U : > t 
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where is the i-th elementary vector. By the Azuma-Hoeffding inequality, 


Pr[|t/.:v«^->|>.]<2exp( ^ll^;,f„l|, ) 

Therefore, integrating by parts, 

r 1 Q r 1 

E exp(|C/i : <1+ / --e^'/^Pr |C/i : > s ds 

V J Jo 2 L 1 

POO 

< 1 + / ds 

Jo 

= C 

for some C* > 0. Then, 

E [exp(||[/ : = E exp (^\Ui : v®(^-^)|V4) 

L 2 

<nE[exp(|[/i :v®('^-i)|V4)' 

i 

< 

where the second first inequality follows from independence. Then, setting 
A = ^/log C/8, we have 

Pr \\\U : > AVnj = Pr [exp(||C/ : ||^/4) > exp(2nlogC) 

E[exp(EJf/»:v^^^-^^lV4)] 

“ exp(2nlogC') 

< (jn^-2n\ogC _ g-nlogC 

by Markov’s Inequality. □ 

Corollary 4. Let D = D{n,k,p) for p G (0,1). Let v G be such that 
||v ||2 = 1. Then 

Pr \\\D : > tj < 

for some constants c,C > 0 (possibly depending on k), where D = D{n, k,p). 
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Proof. For a permutation cj : [/c] —)■ [k] and an order k, dimension n cubical 
hypermatrix M whose i = {ii,... ,ik) multiindexed entry is mi, write for 
the order k, dimension n cubical hypermatrix whose , V(fc)) 

entry is mi<T. By the triangle inequality, 

11^ . ^(g)(fc-l)||^ < ^ . ^(g)(fc-l)||^ 

o-e&k 


whence 


Pr 


1^ . v®(fc-i)|| 


< kl Pr 


\U : > 


A:! 




□ 


Proposition 5. We have 


Pr 


3v G C” : ||v ||2 = 1 and \\D : ^^||2 > Byjn logn = o(l). 


for some constant B depending on k. 

Proof. Let S = l/{4:k^/n) and let V denote the set of vectors {(5(s + s'\/~l) ^ 
—5“^ < s < (5“^, —5“^ < s' < 5~^,s G Z, s' G Z}"- and 


P' = 


w 


|W||2 


: w G P > , 


so that \V'\ < (55) Then, for any v G with ||v ||2 = 1, there is a 
w G P' so that, for each j G [fc], 

max{3ft(|vj — Wj|),$>(|vj — Wj|)} < 5. 

Hence, letting e = v — w, applying symmetry and the triangle inequality, 

\\D : v®(*^-i )||2 = \\D : (w + II 2 

D : + {k- l)e (8) w®^^-^) 

+ e®2 (g) w®(*^-3) + ...) 


< 


D : 


+ (^ - 1) l|e||2||w||2 ^ 


2 
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+ 


k-1 


w 


|fc-3 


+ 


< 


< 




+ 4 


k-l 


6^n + 8 


k-l 


+ ■■■ 


D : 2 ^ (l + 2{k - l)dn^/^ 


1 


< 

< 


+4(/c — l)^5^n + • • •) 

+ 2(A: - l)Jn^/2- 

2 1 — 2(A; — l)(5n^/2 

D : + 4(fc - l)5re^/2 


D : 


+ 1 . 


Therefore, the the union bound and Corollary 01 the probability that there 
exists a V G C” so that ||v|| = 1 and \\D : > By/n logn is at most 

^ Pr [ D -. > By/nlogn\ < 

wGV' ^ 

< (400fc2)^Cn’^(i-^-®') = o(l) 


for some constant B depending on k. 


□ 


Theorem 6. For D = D{n,k,p), p{D) < Bn^^ ^^/"^y/logn with high prob¬ 
ability for some constant B depending on k. 


Proof. Suppose 


D : v'^ 


fc-i 


= Av' 


ok—1 


Since this equation is homogeneous, we assume that ||v ||2 = 1 by scaling v. 
By Holder’s Inequality, 


ok—1 


= V 


o2||(fc-l)/2 
l(fc-l) 


(fc-l)/2 


= V 


o2| 


lfc-1 


|(fc-l)/(fc-2) 

|(fc_l)/(fc_2). 


> ||v°^||in^ 


= n 


12 





































Hence 


D : 


= |A| 

> |A|n 


vofc-i 

l-kl2 


2 


By the previous result, with high probability this equation holds for every 
such A as long as the eigenvalue of largest modulus satisfies 

< By/n logn, 


i-e., 

|A| < i3n*'^“^^'^^\/logn. 

□ 

Note that this bound is not quite tight for k = 2. Indeed, a famous result 
of Fiiredi and Komlos (HD) is that the random symmetric sign ensemble has 
spectral radius 0{y/n) with high probability, instead of 0{-\/n logn), as the 
above result implies. Therefore, the question remains of whether Theorem 
[6] is tight for k > 2. 


5 Piecewise Smoothness of Eigenvalues 


Suppose A = A{t) is a real-analytic function in t € [0,1] of order k, dimen¬ 
sion n real symmetric hypermatrices. Then, by [30], f{q,t) = det(H(t) —gl) 
is a monic polynomial in q of degree n{k — 1)”“^ with real-analytic coeffi¬ 
cients, polynomials in the entries of A{t). For any fixed t G [0, 1], we may 
factor 

r(t) 

hqa)= 

i=l 

where are the distinct roots of f{q,t). For each positive integer m, 

we define the m-th generalized discriminant by 


^mf{q,t) 




Se(K.)l) 


ijGS 

i¥^j 


(When m = 1, Aif{q,t) = n{k — By [33|, the number of distinct 

(/-roots of f{q,t) is the largest m so that Amf{q,t) 7^ 0- Since Amf{q,t) 
is a polynomial whose coefficients are polynomials in the coefficients of /, 
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its coefficients are also real-analytic, so it is identically zero or its roots 
are discrete (and therefore finite in number in [0,1]). Let R be the largest 
integer so that it is not identically zero. Then r{t) = R for all but a finite 
set of points E, and we may write 

F{q,t) = ARf{q,t)= ^ (A, - A,)^ 

a real-analytic, nonzero function on all but E' = [0,1] \ E. Then, by Lemma 
3.2 of [33], we can factor E{q,t) as Ei{q,t) ■ ■ ■ Eji{q,t) in an open interval 
/ about any point t G E' so that the roots (in q) of Ei{q,t) are a single 
C°° function A'(t). It is straightforward to see that (by real-analytic con¬ 
tinuation), because E is discrete, this implies that the q-degree of each of 
the Fi(q,t) is constant on each component of E', and, furthermore, that the 
roots of f{q,t) can be taken to be smooth on each component of E'. 

We may conclude the following. 

Theorem 7. Suppose that A = A{t) is a real-analytic function in t G [0,1] 
of order k, dimension n real symmetric hypermatrices. Then there are func¬ 
tions \i{t), i G [n{m — 1)"'“^], so that the Xi{t) are precisely the eigenvalues 
of A{t), and each Xi{t) is smooth except at finitely many points. 
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